TIME DOMAIN EQUALIZER FOR DMT MODULATION 
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CROSS-REFERENCE TO RELATED APPLICATIONS 
[0001] Not applicable. 



STATEMENT REGARDING FEDERALLY SPONSORED RESEARCH OR 
DEVELOPMENT 

[0002] Not applicable. 



BACKGROUND OF THE INVENTION 

[0003] This invention is in the field of data communications, and is more 

specifically directed to modulator/ demodulators (modems) for use in such 
communications. 

5 [0004] As is well-known in the art, many modem data communications utilize 

multicarrier modulation (MCM) to provide high data rates. According to this 
technology, mtiltiple carrier-modulated data streams are transformed into a single 
waveform for transmission; the inverse transformation at the receiver separate the 
multiple carriers, and recover the modulating symbols, MCM techniques are used in 

10 such communications applications as such as Digital Subscriber Line (DSL) services, 
fixed wireless, digital audio broadcast (DAB), and terrestrial digital video broadcast 
(DVB-T). MCM fimdamentals are described in Bingham, ''Multicarrier Modulation for 
Data Transmission: An Idea Whose Time Has Come", IEEE Communications Magazine 
(May, 1990), pp. 5-14, and Cioffi, A Multicarrier Primer, T1EL4/91-157, (Amati Comm. 

15 Corp. and Stanford University, November 1991). 



[0005] One important and now popular modulation standard for DSL 

communication is Discrete Multitone (DMT). According to DMT technology, the 
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available spectrum is subdivided into many subchannels (e.g., 256 subchannels of 4.3125 
kHz). Each subchannel is centered about a carrier frequency that is phase and 
ampUtude modulated, typically by Quadrature Amplitude Modulation (QAM), in which 
each symbol value is represented by a point in the complex plane; the number of 

5 available symbol values depends, of course, on the number of bits in each symbol. 
During initialization of a DMT communications session, the number of bits per symbol 
for each subchannel (i.e., the "bit loading") is determined according to the noise 
currently present in the transmission channel at each subchannel frequency and 
according to the transmit signal attenuation at that frequency. For example, relatively 

10 noise-free subchannels may communicate data in ten-bit to fifteen-bit symbols 
corresponding to a relatively dense QAM constellation (with short distances between 
points in the consteUation), while noisy channels may be limited to only two or three bits 
per symbol (to aUow a greater distance between adjacent points in the QAM 
constellation). In this way, DMT maximizes the data rate for each subchannel for a 

15 given noise condition, permitting high speed access to be carried out even over 
relatively noisy twisted-pair lines. 

[0006] DMT modulation also permits much of the processing of the data to be 

carried out in the digital domain. Typically, the incoming bitstream is serially received 
and then arranged into symbols, one for each subchannel (depending on the bit 

20 loading). Reed-Solomon coding and other coding techniques are also typically appUed 
for error detection and correction. Modulation of the subchannel carriers is obtained by 
appHcation of an inverse Discrete Fourier Transform (IDFT) to the encoded symbols, 
producing the output modulated time domain signal. This modulated signal is then 
serially transmitted. All of these operations in DMT modulation can be carried out in 

25 the digital domain, permitting implementation of much of a DSL modem, and 
particularly much of the processing-intensive operations, in a single chip (such as a 
Digital Signal Processor, or DSP). 

[00071 The discrete output time domain signal from the modulation is then 

converted into a time-domain analog signal by a conventional digital-to-analog 
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converter. The analog signal is then communicated over the transmission channel to the 
receiving modem, which reverses the process to recover the transmitted data. The non- 
ideal impulse response of the traiismission channel of course distorts the transmitted 
signal. Accordingly, the signal received by the receiving modem will be a convolution 
5 of the analog output waveform with the impulse response of the transmission channel 
Ideally, the DMT subchannels in the received signal are orthogonal so that the 
modulating data can be retrieved from the transmitted signal by a Discrete Fourier 
Transform (DFT) demodulation, under the assumption that convolution in the time 
domain corresponds to multiplication in the frequency domain. 

10 [0008] One may express the time-domain signal y(t) at the receiver, based on a 

transmitted time-domain signal x(t), as: 

y(t) = x(t)®h(t) 

This expression simply states that the received signal y(t) is the time-domain convolution of 
the input signal x(t) with the channel impulse response h(t). In the ideal case, this time- 
15 domain expression can be expressed in the frequency-domain as: 

Y(g))=X(cd>H(g)) 

where X(a)), H((d), and Y(od) are the respective frequency-domain representations of time- 
domain signals x(t), h{t), y(t). Considering that the transmitted signal x(t) is the IDFT of the 
symbol sequences at their respective subchannel frequencies, the frequency-domain 
20 spectrum X(g)) corresponds to the symbols themselves. According to the DMT modulation 
technology, the receiver can therefore retrieve the symbols X((X)) by removing the channel 
response H(oo) from the DFT of the frequency-domain received signal Y(a)); this can 
typically be performed by a single-tap frequency domain equalizer. 

[0009] However, time domain convolution corresponds to frequency domain 

25 multipUcation only if the input sequence is infinitely long, or if the input sequence is 
periodic. Because the number of subchannels is finite, however, the number of real- 
valued time-domain samples at the output of the transmitter IDFT (i.e., the "block" 
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length) is also firdte. Accordingly, it is useful to make the transmitted signal appear to 
be periodic, at a period on the order of the block length. A well-known technique is the 
use of a cyclic prefix in the transmitted data stream. The cyclic prefix is generally 
defined as a number v of samples at the end of a block of samples in the output 
5 bitstream. These v samples are prepended to the block, prior to digital-to-analog 
conversion. This effective periodicity in the input sequence thus permits the use of a 
DFT to recover the modulating symbols in each subchannel, tmder the assumption that 
the cyclic prefix lengtii is less than the channel length. 

[0010] In effect, the use of the cyclic prefix eUminates inter-symbol interference 

10 (ISI) between adjacent data frames, and inter-carrier interference (ICI) between 
subchannels. ISI generally arises from distortion and spreading of the transmitted signal 
over the channel, which causes the end of one DMT symbol to overlap into the 
beginning of the next DMT symbol. ICI affects the independence of the subcarriers, 
resulting in loss of orthogonality among the subchannels. Of course, if the subchannels 
15 are no longer orthogonal to one another, the modulating data on tihese subchannels 
cannot be separated at the receiver. 

[0011] However, in order for the input sequence to truly appear periodic, and 

for the ISI interference to be contained within the redundant prefix of the block, the 
cyclic prefix must be longer than the length of the chaimel response. To ensure that ISI 

20 is not present in the transmitted signal, therefore, one may of course use a long cyclic 
prefix. Because the cychc prefix does not itself contain any information or ''payload'' 
(considering that the prefix is redundant with the samples at the end of the block), a 
cyclic prefbc of any length reduces the efficiency of the transmission. Accordingly, some 
transmission channels may have impulse responses that are so long as to prevent DMT 

25 data transmission at a reasonable efficiency. 

[0012] In many DSL subscriber loops, the transmission channel response may 

indeed be very long, requiring an extremely long cyclic prefix, and resulting in a 
significant loss of data rate. By way of further background, time domain equalizers are 



known in the art as useful in effectively reducing the length of the channel response, for 
example as described in Chow et al., "A Discrete Multitone Transceiver System for 
HDSL Applications", IEEE Journal on Selected Areas in Communications, Vol. 9, No. 6 
(Aug. 1991), pp. 895-908. A time domain equalizer is typically a small finite impulse 
5 response digital filter at the receiver that is applied to the received signal after 
conversion from analog to digital, but prior to removal of the cyclic prefix and prior to 
the DFT into the frequency domain (hence the name time domain equalizer). The time 
domain equaUzer is intended to reduce the effective length of the channel response to 
less than the length of the cyclic prefix. 

10 [0013] Figure 1 illustrates an algorithm for defining the response of a time 

domain equalizer according to the conventional minimum mean squared error (MMSE) 
technique. In the MMSE algorithm, an input signal x(t) is applied to channel response 
h(t) model 2, which may be derived from an estimate of the channel response. The 
application of the input signal x(t) to channel response model 2 is then added to a noise 

15 estimate n(t), via adder 3, to produce received output signal y(t), which is applied to 
time domain equalizer 4. Time domain equalizer 4 may be implemented as an adaptive 
digital filter, as will be described below. The output of time domain equalizer 4 is 
appHed to one input of adder 5. The input signal x(t) is also applied, through delay 
stage 6 (which compensates for the delay through the other leg), to desired impulse 

20 response model 8. The desired impulse response of model 8 is selected to be of a length 
that is less than the length of the cyclic prefix to be used. The output of desired impulse 
response model 8 is appHed to a negative input of adder 5, which generates an error 
signal e(t) at its output that is applied to time domain equalizer 4. 

[0014] hi defining the coefficients to be used in a digital filter representation of 

25 time domain equalizer 4, time domain equalizer 4 is iteratively adjusted in response to 
the error signal e(t), in a direction to minimize error signal e(t). Upon convergence, the 
output of time domain equaUzer 4 corresponds to the input signal x(t) convolved with 
the desired unpulse response of model 8, from which the input signal x(t) can be readily 
recovered. The coefficients of the digital filter used to realize time domain equalizer 4 at 
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this converged state can then be applied as a time domain equalizer in a receiving 
modem, with the equalizer then serving to reduce the effective length of the 
transmission channel resporise to the desired length, preferably witiiin the length of the 
cyclic prefix. The combination of the channel response h(t) and the time domain 
equalizer filter is often referred to as the target impulse response, or TIR. 

[0015] The convergence algorithm can be solved by a convenient matrix 

formulation. A vector xv = [iVqW^ ...Wif can be defined as the 1+1 sample TEQ impulse 
response, and a vector b = [b^b^ ..\Y can be defined as the k +1 sample target channel. 
Where 3/ = |yo3/i "-y-/? ^^^^ samples of Ae channel output, and 

^[x_^x_^^j -"^-^-itF is defined as a delayed input sequence, the error e[n] for n=0 
can be derived as: 

which corresponds to the difference between the outputs of the two channels form TEQ 4 
and target channel response 8 of Figure 1, as produced by adder 5. The mean-squared 
error E[e2[0]] can thus be given by: 

E[e'[0]] = iJl^RyyW + b'R.A- ^E^Ryxl^ 
where Rxx and Ryy are the autocorrelation matrices for and y , respectively, and where 
Ryx is their cross-correlation matrix. 

[0016] In practice, minimization of the mean-squared error E[e^n]] computes the 

values of filter matrices w and b, and time delay A, that minimizes tiie function. In 
order to avoid the trivial solution of zero-valued matrices w and b , either a unit tap 
constraint (UTC) on matrix b (bk = 1) or a unit norm constraint (UNC) on matrix w 
( \\iv\\ = 1 ) is applied. Standard Lagrange multiplier techniques derive a solution in either 
case, depending upon the mafa-ix Ruse == Ryy - RyxRxx'^Rxy^ For the UNC case, tire time 
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domain equalizer vector w becomes the eigenvector of Rmse that is associated with the 
minimum magnitude eigenvalue. In the UTC case, the time domain equaHzer is: 



w 



where 5^ =1 for sample k, and zero elsewhere. 

5 [0017] Variations on title MMSE implementation of a time domain equalizer are 

known in the art. Van Kerckhove et al., "Adapted Optimization Criteria for FDM-based 
DMT-ADSL Equalization", ICC 1996, pp. 1328-34 describes an approach in which the 
MMSE mininuzation of the time domain equalizer is tuned for an FDM-based ADSL 
modem and is performed with the injection of virtual noise; the noise signal is virtual in 

10 that it is mathematically generated rather than based on noise measurements. 

[0018] In most asymmetric DSL (ADSL) appHcations, as is weU known, 

upstream (subscriber to central office) communications are in a low frequency band 
while downstream (central office to subscriber) communications are in a high frequency 
band, where the two frequency bands do not overlap one another; this approach is 
15 referred to as frequency division multiplexing (EDM). TypicaUy, therefore, analog 
filtering is performed at the receiver to cancel echoes of its upstream signal from 
interfering with the received downstream signal. This analog filtering is a significant 
contributor to the overall target impulse response (TIR), especiaUy if the high-pass 
downstream filter is required to have a sharp rolloff characteristic. 

20 [0019] Conventional optimization of a time domain equalizer in an ADSL 

modem therefore involves difficult tradeoffs, hi theory, a time domain equalizer can be 
derived that compensates both for a long channel response and also a sharp high-pass 
filter characteristic, however such a conventional time domain equalizer will necessarUy 
be quite complex. In addition, the resulting TEQ wiU add significant energy into the 

25 low-frequency band due to the high-pass filtering, which will necessarily amplify noise 
in this band and cause it to spread into the low-frequency symbols, reducing the signal- 



to-noise ratio and also impacting resolution of the TEQ coefficients for high frequency 
components. 

[0020] By way of further background, it has been observed that ttie frequency 

domain behavior of conventional MMSE TEQs when applied to EDM modems is qtiite 

5 poor. Near nulls often result in the passband region, while the downstream DFT 
demodulation process causes appreciable spectral leakage of noise power between 
adjacent frequency bins, including into the near null frequencies. These near nulls 
therefore result in a loss of charmel capacity. To address this issue, alternative MMSE 
design of the time domain equalizer is based on the maximizing of an approximation to 

10 the system channel capacity. According to this approach, the time domain equalizer is 
designed by maximizing a product of the power spectra of the target chaimel over the 
DFT bins in the passband regions of the received signal, as described in Al-Dhahir et al., 
''Optimum Finite Length Equalization for Multicarrier Transceivers", IEEE Trans. 
Comm., Vol. 44, No. 1 (Jan. 1996), pp. 56-64. In effect, this maximization elimdnates near 

15 nulls in the spectrum of the TEQ within the pass band. Because the design of time 
domain equalizers using this criterion requires a computationally complex non-linear 
constrained optimization procedure, approximations to this approach have been 
developed. According to Farhang-Boroujeny et al., "An Eigen-Approach to the Design 
of Near-Optimum Time Domain Equalizers for DMT Transceivers'', ICC 1999, an ad hoc 

20 approximation to the capacity maximization problem is to define the time domain 
equalizer from a linear combination of the eigenvectors of the correlation matrix of the 
TEQ input that provides a TIR witii no null in its spectrxmi and provides a relatively low 
MSE. 
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BRIEF SUMMARY OF THE INVENTION 

[0021] It is therefore an object of the present invention to provide a time domain 

equalizer tiiat optimally shortens the effective transmission channel response to 
maximize channel capacity. 

5 [0022] It is a further object of this invention to provide such a time domain 

equalizer that is suitable for use in ADSL transceiver appUcations, in which sharp high- 
pass filters are utilized. 

[0023] It is a further object of this invention to provide a me&od for designing 

such a time domain equalizer. 

10 [0024] It is a further object of the invention to provide a transceiver, such as a 

modem, including such a time domain equalizer. 

[0025] Other objects and advantages of the present invention will be apparent to 

those of ordinary skill in the art having reference to the following specification together 
with its drawings. 

15 [0026] The present invention may be implemented into a receiver, such as used 

in a DSL transceiver operating according to discrete multitone modulation. In this 
invention, a time domain equalizer is provided for effectively reducing the length of the 
transmission channel response to below a limit corresponding to the length of a cyclic 
prefix included with each block of transmitted time-domain data. The time domain 

20 equalizer is designed according to a constrained mean-squared-error minimization of 
the channel response and time domain equalizer, where the constraint is a frequency 
domain flatness constraint of arbitrary phase. 
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BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWING 

[0027] Figure 1 is a diagram of a conventional (MMSE) time domain equalizer 

algoriflim. 

[0028] Figure 2 is a fimctional block diagram of commurucations between two 

5 DMT transceivers, where at least the receiving transceiver is constructed according to 
the preferred embodiment of the invention. 

[0029] Figure 3 is an electrical diagram, in block form, of a transceiver 

constructed according to the preferred embodiment of the invention. 

[0030] Figure 4 is a flow diagram illustrating a process of determirung 

10 coefficients in the time domain equalizer used in the transceiver of Figures 3 and 4 
according to the preferred embodiment of the invention. 

[0031] Figure 5 is a simulation plot of downstream subchannel capacity in the 

communication system of Figure 2 according to the preferred embodiment of the 
invention, in comparison with conventional time domain equalizer algorithms. 

15 



10 



DETAILED DESCRIPTION OF THE INVENTION 

[0032] The present invention will be described in connection with an example of 

its implementation in a transceiver, such as a Digital Subscriber Line (DSL) modem. It 
will be apparent to those skilled in the art having reference to this specification that this 

5 invention is particularly well-suited for use in such an application. However, it is also 
contemplated that ttiis invention will be of similar benefit in many other applications 
that involve the use of a time domain equalizer, particularly in its appUcation of 
shortening the impulse response of a transmission channel. It is therefore to be 
understood that these and other alternatives to the embodiment described below are 

10 contemplated to be within the scope of the invention as claimed. 

[0033] Figure 2 functionally illustrates an example of a DSL communication 

system into which the preferred embodiment of the invention is implemented. In the 
system of Figure 2, only one direction of transmission (from transmitting modem 10 to 
receiving modem 20) is illustrated; it will of course be tmderstood by those skilled in the 

15 art that data will also be communicated in the opposite direction (from modem 20 to 
modem 10). According to this embodiment of the invention, the DSL communications 
carried out in the system of Figure 2 are of the asymmetric DSL (ADSL) type, with 
communications in the opposing directions wiU be carried out in non-overlapping 
frequency bands according to frequency division multiplexing (FDM). In this 

20 arrangement, so-called "downstream" communication from the telephone company 
central office to the subscriber's modem is in a higher frequency band (e.g., above 138 
kHz) while "upstream" communication from the subscriber to the central office is at a 
lower frequency band. For purposes of the present invention. Figure 2 can be 
considered to illustrate the functions carried out in downstream communication, in 

25 which case transmitting modem 10 is at the central office and receiving modem 20 is the 
subscriber, or client, modem. 

[0034] As shown in Figure 2, transmitting modem 10 receives an input bitstream 

that is to be transmitted to receiving modem 20. The input bitstream may be generated 
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by a computer at the same location (e.g., the central office) as transmitting modem 10, or 
alternatively and more likely is generated by a computer network, in the Internet sense, 
coupled to the central office and transmitting modem 10, The input bitstream is a serial 
stream of binary digits, in the appropriate format as produced by the data source. 

5 [0035] The input bitstream is received by bit to symbol encoder 11 in 

transmitting modem 10. Encoder 11 performs multiple functions in this embodiment. 
One such function is to group the bits in the input bitstream into multiple-bit symbols, 
for example ranging up to as many as fifteen bits. The symbols wiU be the values used 
to modulate the various subchannels, as will be described below. The symbols typically 

10 are not necessarily representative of the transmitted data itself, but instead simply 
correspond to grouping of the serial bitstream for broadband transmission. The number 
of bits in each symbol produced by encoder 11 wiU vary, in the DSL application, 
according to the bit loading assigned to each subchannel in the initialization of the 
commuiucation session, as known in the art. In addition, encoder 11 may also use error 

15 correction codings such as Reed-Solomon coding, for error detection and correction 
purposes; other types of coding, such as trellis or Viterbi coding, may also be applied for 
additional signal-to-noise ratio improvement. In addition, the symbols generated by 
encoder 11 are typically complex symbols, including both amplitude and phase 
information, and correspond to points in the appropriate modulation constellation (e.g., 

20 quadrature amplitude modulation, or QAM). 

[0036] The encoded symbols are then appHed to inverse Discrete Fourier 

Transform (IDFT), or inverse Fast Fourier Transform (IFFT), function 12. IFFT function 
12 associates each input symbol with one subchannel in the transmission frequency 
band, and generates a corresponding number of time domain symbol samples according 
25 to the Fourier transform. These time domain symbol samples are then converted into a 
serial stream of samples by parallel-to-serial converter 13. Functions 11 through 13 thus 
convert the input digital bitstream into a serial sequence of symbol values representative 
of the sum of a number of modulated subchannel carrier frequencies, the modulation 
indicative of the various data values. Typically, if N complex symbols are presented to 
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IFFT ftmction 12, IFFT function 12 outputs a block of 2N real-valued time domain 
samples. 

[0037] In ftmction 14, a cyclic prefix is then added to each block of samples 

presented by IFFT function 12 through parallel-to-serial converter 13. The cyclic prefbc 

5 is constructed by a selected number of sample values at the end of the block, and these 
values are then prepended to the block by function 14. For example, if each block 
includes 512 samples, a typical cycHc prefix is on the order of thirty-two samples. As 
described above in the Backgrotind of the Invention, the cyclic prefbc has the effect of 
limiting intersymbol interference (ISI) due to energy from a previous symbol spreading 

10 into the next symbol due to the channel response; in other words, the cyclic prefix causes 
the datastream to appear to be periodic, so that the equivalence between frequency 
domain multiplication and time-domain convolution is valid. Those skilled in the art 
having reference to this specification wiU readily recognize that each of functions 11 
through 14 may be carried out, and preferably are carried out, as digital operations. As 

15 such, it is contemplated tiiat a high-performance digital integrated circuit, such as a 
digital signal processor (DSP) having computational power similar to or greater than the 
TMS320c5x and TMS320c6x DSPs available from Texas Instilments Incorporated will be 
suitable for these ftmctions. 

[0038] Digital filtering is then applied to the datastiream with cyclic prefix, in 

20 function 15. This digital filtering function 15, in combination with analog filtering, 
incorporates the filtering required to accommodate the large dynamic range and wide 
frequency bands involved in DSL tiansmission, as described in U.S. Patent No. 
6,226,322, which is commonly assigned with this application and incorporated herein by 
reference. Typical digital filtering operations involved in function 15 may include 
25 interpolation filtering to increase the sample rate, a digital low pass filter for removing 
image components, and digital high pass filtering to eliminate POTS-band interference. 
The digitally-filtered datastieam signal is then converted into the analog domain, by 
digital-to-analog converter 16. Analog filtering function 18 is then appHed to the output 
analog signal, prior to its tiansmission. The filtering performed by function 18 typically 
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includes at least a low-pass filter. As described in U.S. Patent No. 6,226,322, digital filter 
fxmction 15, digital-to-analog converter 16, and analog filter function 18 may be 
implemented in coder/decoder (codec) integrated circuit in transmitting central office 
modem 10. 

5 [0039] The output of analog filter 18 is then appUed, via the appropriate line 

driver and other circuitry (not shown in Figure 1) to transmission channel H, for 
forwarding to receiving modem 20. According to conventional ADSL technology, the 
transmission channel consists of some length of conventional twisted-pair wires. The 
transmission channel H communicates the transmitted analog signal, but adds distortion 

10 according to its impulse response h(t) as described above. 

[0040] The downstream transmitted signal is then received by receiving modem 

20, which, in general, reverses the processes of transmitting modem 10 to recover the 
input bitstream as the output bitstream. Referring now to Figure 3, the construction of 
receiving modem 20, as a transceiver (i.e., for both transmittmg and receiving), will first 
15 be described. 

[0041] As shown in Figure 3, modem 20 includes hybrid circuit 30, which is 

connected to transmission channel H in the form of a twisted-pair facihty. Hybrid 
circuit 30 is a conventional circuit that converts the two-wire arrangement of the 
twisted-pair facility to dedicated transmit and receive lines connected to line driver and 

20 receiver 32, considering that modem 20 is suitable for carrying out both the receipt of 
downstream commtmications from the central office and also the transmission of 
upstream communications to the central office. Line driver and receiver 32 is a high- 
speed line driver and receiver for driving and receiving ADSL signals over twisted-pair 
lines; an example of a suitable line driver and receiver circuit is the THS7102 line 

25 driver/ receiver available from Texas Instruments Incorporated. Line driver and 
receiver 32 is bidirectionaEy coupled to coder/ decoder (codec) circuit 34, which carries 
out analog filtering, analog-to-digital conversion, and some amount of digital filtering, 
as wiU be described below. According to the preferred embodiment of the invention, in 
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which the ADSL communications are carried out according to a frequency division 
multiplexing (FDM) scheme, the upstream and downstream communications are in 
separate, non-overlapping, frequency bands, in which case codec circuit 34 high-pass 
filters the incoming downstream signal to eliminate any interference from the upstream 
signal being transmitted by modem 20. An example of a suitable codec device may be 
selected from the TLV320ADlx device family available from Texas Instruments 
Incorporated. Hybrid circuit 30, line driver and receiver 32, and codec 34 are often 
referred to, in the aggregate, as an "analog front end". 

[0042] Modem 20 also includes DSP 35, which serves as a digital transceiver for 

DSL communications. As noted above, DSP 35 is a high performance digital signal 
processor, for carrying out the digital operations of the present invention as wiU be 
described below; exemplary devices suitable for use as DSP 35 include the TMS320c6x 
family of DSPs available from Texas Instruments Incorporated. A conventional interface 
36 couples DSP 35 to the client workstation W, in the usual manner. 

[0043] Referring back to Figure 2, the functions of modem 20 in processing 

received downstream communications according to the preferred embodiment of the 
invention will now be described. FoUowing physical receipt of the signal through 
hybrid circuit 30 and line driver and receiver 32 (Figure 3), analog filtering function 21 is 
performed by codec 34, primarily to remove high frequency noise and aUasing from the 
incoming signal; as described in U.S. Patent No. 6,226^22, equalization of the analog 
signal may also be performed to compensate for line attenuation characteristics of 
transmission channel H. Analog-to-digital conversion process 22 then converts the 
filtered analog signal into the digital domain, following which conventional digital 
filteriag function 23 is applied to augment the function of the analog filters. The 
combination of analog and digital filter functions 21, 23 also preferably includes some 
high-pass filtering to isolate the higher frequency downstream signal from the lower 
frequency upstream communications, with the necessary rolloff filter characteristic 
being quite sharp in this FDM case. Functions 21, 22, and 23 are preferably performed 
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by codec device 34 of Figure 3, to provide a filtered digital data stream to DSP 35 for 
digital processing, as will now be described. 

[0044] Referring back to Figure 2, digital filter function 23 forwards the filtered 

digital datastream to time domain equalizer (TEQ) 24. TEQ 24 is preferably a finite 
5 impulse response (FIR) digital filter^ implemented as a software routine executed by 
DSP 35 (of Figure 3), that is designed to effectively shorten the length of the impulse 
response of the transmission channel H, including the filtering that is performed prior to 
receipt by TEQ 24. The design of this TEQ filter is realized by the selection of the 
particular coefficients of the FIR implementing TEQ fimction 24 during initialization, or 
10 ''training" of modem 20 ia combination with modem 10 upon establishing a 
communications session. The initialization of the coefficients of TEQ 24 according to the 
preferred embodiment of the invention will be described in detail below. 

[0045] Following TEQ 24, the cyclic prefix is removed from each received block 

in fimction 25. Serial-to-parallel converter 26 then converts tiie datastream into a 

15 number of samples (2N) for application to Discrete Fourier Transform (DFT) function 27, 
Because the received datastream applied to DFT function 27 is a time-domain 
superposition of the modulated subchannels, the DFT of this datastream will recover the 
modulating symbols at each of the subchannel frequencies, reversing the IDFT 
performed by function 12 in the transmission processing by transmitting modem 10 at 

20 the central office. The output of DFT function 27 is a frequency domain representation 
of the transmitted symbols multiplied by the frequency-domain response of the effective 
transmission channel, imder the assumption that the cyclic prefix is at least as long as 
the channel response h(t), shortened by TEQ function 24. Frequency-domain 
equalization (FEQ) function 28 then divides out the frequency-domain response of the 

25 effective channel, recovering the modulating symbols. Symbol-to-bit decoder function 
29 then resequences the symbols into a serial bitstream, decoding any encoding that was 
applied in the transmission of the signal, and producing an output bitstream that 
corresponds to the input bitstream upon which the transmission was based. As shown 
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in Figure 3, this output bitstream is then forwarded through interface 36 to client 
workstation W. 

[0046] According to the preferred embodiment of the invention, TEQ function 24 

is designed in a particularly beneficial manner for FDM ADSL applications. As 
5 discussed above in the Background of the Invention, conventional mean-squared error 
(MSE) minimization (or MMSE) approaches to the selection of the TEQ coefficients often 
were not well-suited for FDM ADSL applications because these minimizations often 
resulted in near nulls within the frequency bands of interest which, in combination with 
spectral noise leakage resulting from DFT demodulation, can result in very poor signal- 
10 to-noise ratios in some subchannels. In addition, the steep rolloff requirements of the 
high-pass filtering used to isolate the downstream signal also can cause the TEQ to 
amplify noise in the stop band region. The present invention addresses these Ltmitations 
of conventional TEQ design and initialization, as will now be described. 

[0047] As discussed above, conventional MMSE design of a time domain 

15 equalizer (TEQ) involves the ininiinization of an MSE cost function based on the mean- 
squared error E[e^[n]]: 

MSE - E[e^ [n]] - u?^R^ w + b^R,^b- Iw^Ky^ w 

where vector zt; is an 1+1 sample TEQ impulse response, where Rxx and Ryy are the 
autocorrelation matrices of vector (which is k delayed samples of the input bitstream) 
20 and vector y (the last 1+1 samples of channel output), respectively, and where Ryx is their 
cross-correlation matrix. The sampled channel output vector y is before the TEQ w is 

appHed, According to the preferred embodiment of the invention, however, near nuUs and 
stop band amplification in the TEQ response are avoided by enforcing a ''flatness" 
constraint: 

25 flatness = {w~b^ f (l!^ - §jt ) 
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where 5^, is a unit magnitude vector of liie same length as TEQ impulse response vector w 

with tap k equal to 1. According to Parseval's theorem, this constraint can be restated in 
the frequency domain as: 

flatness- J||W(ei^)^A^(e^^)f do 

-71 

5 Because the transform Aj^(e^'^) = e'®^ has unit magnitude and arbitrary (linear) phase, the 
frequency domain expression for the flatness expresses the total deviation of the TEQ 
response W(e^''^) from a function having a flat spectral magnitude. If the magnitude of 
the TEQ response W(e^'^^) is nearly unity, the flatness term will be smaU; on the other 
hand, if large magnitude variations are present in the TEQ response W(e^®^) over an 
10 appreciable part of the domain [-tc, n], the flatness term will be significant. 

[0048] According to the present invention, the design or initialization of TEQ 

function 24 in modem 20 uses a cost function J( for constrained MMSE by including a 
flatness term as an additional constraint: 

15 where 5^ =1 for sample k, and zero elsewhere, and where y is a scaling constant selected to 
quantify the effect of spectral flatness on the selection of the TEQ filter vector w . No 
additional coristraint (e.g., UTC or UNC) is necessary for non-zero y, because the flatness 
term non-trivializes the |(; =0 solution. The optimal TEQ filter vector w becomes: 

t£o-arg min^ ]{w) 

20 Recalling the matrix Rmse = Ryy - RyxRxx-^Rxy, and the above expression for cost function 
]{w) , one may derive an expression for the optimal TEQ filter vector Wq : 
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Proper selection of flatness scaling constant y provides an optimal TEQ filter vector Wq for 
FDM ADSL channels. The effect of flatness scaling constant y, and its selection in 
determining the TEQ filter vector, will be described in further detail below. 

[0049] Referring now to Figure 4, a method of initializing TEQ function 24 in a 

5 subscriber modem, such as receiving modem 20 in the system of Figure 2, according to 
the preferred embodiment of the invention will now be described. As known in the art, 
the initializing or training of DSL modems is performed by way of communication 
between the central office modem and a subscriber modem when a connection is first 
made. The training process includes such operations as determining bit loading of the 
10 DMT subchannels, and the setting of equalizers (including TEQ function 24 and FEQ 
function 28). U.S. Patent No. 6,219,378, commonly assigned with this appHcation and 
incorporated herein by reference, describes an example of the initialization or training of 
a DSL modem. 

[0050] According to tiiis preferred embodiment of the invention, the training 

15 process begins with process 50, in which a training sequence is generated by 
transmitting modem 10 in the central office, for receipt by receiving modem 20. In 
process 50 according to this preferred embodiment of the invention, the training 
sequence is a periodic pseudo-random sequence x'(k) that is generated by transmitting 
modem 10 and that can be reproduced at receiving modem 20 for purposes of 
20 comparison. The periodic nature of this sequence permits its distortionless transmission 
without requiring a cyclic prefix, because the periodic signal renders tune-domain 
convolution equivalent to frequency-domain multiplication, permitting the accurate 
estimates of the commtmication channel H. Sequence x'(k) is converted to an analog 
signal, x'(t), prior to transmission. 

25 [0051] In process 52, receiving modem 20 detects a received periodic signal y'(t) 

responsive to the transmitted signal x'(t) based on sequence x'(k). Considering the 
overall transmission channel impulse response h'(t), periodic signal y'(t) corresponds to 
the time-domain convolution of signal x'(t) with the effective channel response h'(t). 
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Because receiving modem 20 can reproduce the sequence x'(k), receiving modem 20 can 
derive an estimate of the channel response h^t) from a comparison of the received signal 
y'(t) and a corresponding recovered sequence y'(k) with the pseudo-random sequence 
x'(k), which is of course the expected sequence. 

5 [0052] According to this preferred embodiment of the invention, DSP 35 in 

receiving modem 20 derives, in process 54, autocorrelation matrices Rxx and Ryy based on 
the (known) locally generated pseudo-random training vector and the received 
signal vector y, respectively, and their cross-correlation matrix Ryx, Based on these 
correlation matrices, receiving modem 20 also derives MSE matrix Rmse = Ryy - RyxRxx' 

10 ^Rxy. for the pseudo-random sequence x'(k) as generated, and sequence /(k), as the 
result of process 54. 

[0053] As noted above, one may consider the optimal TEQ filter vector Wq as: 

At this point, however, the flatness scaling constant y is not yet determined; indeed, the 
15 value of flatness scaling constant y determines the optimal projection of the eigenvectors of 
Rmse for the optimal TEQ filter vector and is therefore not determined a priori according 
to the preferred embodiment of the invention. The correlation matrix Rmse is Hermitian, 
however, and therefore can be written in the form of its eigenvectors Q = 

and its eigenvalue matrix A = diag{X,i, A,2, . . . , ^n}: 

20 Rmse = QAQ* 

Further, the ith eigenvalue h returns the MSE solution when its eigenvector qi is the TEQ 
filter. Accordingly, one may derive an equivalent solution for optimal TEQ filter vector 

from: 



Eo=Q 
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(Q*h) 



In effect, optimal TEQ filter vector is a linear combination of the eigenvectors qi with 
weights Q as follows; 



y 

These coefficients o have been obseived, in connection with this invention, to exhibit a 
5 sahiration behavior as a function of flatness scaling constant y. With a small y«K the 
denominator of the weights Ci become large, driving the coefficient ci itself to zero; 
conversely, as flatness scaling constant y approaches and exceeds eigenvalue Xi, the 
coefficient increases rapidly and saturates at c^ =qiUj^. As a result, as noted above, the 
value of flatness scaling constant y can have an effect on the selection of the eigenvectors 
10 that project onto optimal TEQ filter vector Wq . 

[0054] In order to arrive at this eventual solution, therefore, referring back to 

Figure 4, DSP 35 derives the set Q of eigenvectors q and the set A of eigenvalues X of the 
correlation matrix i^MSE, in process 56. It is contemplated that conventional numerical 
techniques for deriving the eigenvalues and eigenvectors for correlation matrix Rmse 
15 may be readily applied by those skilled in the art having reference to this specification. 
Specifically, it is contemplated that conventional Cholesky decomposition techniques 
and the like are suitable for use in this regard. 

[0055] Once the eigenvectors q and eigenvalues of correlation matrix Rmse are 

determined, DSP 35 next evaluates the cost fimction ]{w): 

20 ]{w) = MSE + y{w~5j^Y 

which includes the flatness constraint, over a series of values of the flatness scaling constant 
y, in process 58. Considering the saturation behavior of the linear coefficients Ci noted 
above, the trial values of flatness scaling constant y are between the minimum-valued 
eigenvalue krran and the maximixm-valued eigenvalue Xwax, as it has been observed that the 
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TEQ filters restilting from such flatness scaling constant values provide good MSE 
performance in the time domain, while avoiding near null points in the frequency domain. 



In addition, because the matrix 



is diagonal, its inversion and thus the cost function 



evaluation for multiple values of flatness scaling constant y is computationally simple, and 
can readily and quickly be performed by DSP 35. 

[0056] In process 60, the value of flatness scaling constant y providing the 

minimum value of the cost function ]{w) is determined, and is applied to the solution 
equation: 



10 to solve for the optimal TEQ filter vector , in process 60, In process 62, this filter vector 
Wq is then applied as coefficients to the digital FIR filter applied by DSP 35 as TEQ function 
24. As noted above, this optimization of the TEQ filter provides excellent MSE 
performance, and thus good performance in the shortening of the channel response, while 
avoiding near nulls in the frequency passband of interest and avoiding noise amplification 

15 in the stop band region. 

[0057] Alternatively to the method of Figure 4, one may perform an MMSE 

rninirnization for a value selected flatness scaling constant y, if desired. Because the 
flatness scaling constant y is preferably within the range of the eigenvalues of the 
correlation matrix, however, it is contemplated that the method described above relative 
20 to Figure 4 is preferable. 

[0058] The preferred embodiment of the present invention has been simulated 

over a wide range of test loops in an ADSL system, specifically over the test loops 
specified by the ANSI standard, which include varying lengths of different gauge 
twisted-pair wire. Figure 5 illustrates the results of this simulation, in which plot 70 
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illustrates the channel capacity according to the preferred embodiment of the invention. 
By way of comparison^ plot 72 shows the channel capacity using a conventional MMSE 
minimization in TEQ design, and plot 74 shows the channel capacity for a TEQ designed 
according to the technique of ad hoc approximation to the capacity maximization 
5 problem, described in the Farhang-Boroujeny et al reference cited above. The channel 
capacity provided by the present invention is thus an improvement over that provided 
by conventional TEQ designs. 

[0059] While the present invention has been described according to its preferred 

embodiments^ it is of course contemplated that modifications of, and alternatives to, 
'^=y 10 these embodiments, such modifications and alternatives obtaining the advantages and 

I =j benefits of this invention, will be apparent to those of ordinary skill in the art having 

* 'f\ 

J^J reference to this specification and its drawings. It is contemplated that such 

modifications and alternatives are within the scope of this invention as sxibsequenfly 
claimed herein. 

II 15 
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